Attorney Docket No.: 020824-0035 12US 
LeapFrog Docket No. 157.01 



PATENT APPLICATION 

ELECTROGRAPHIC POSITION LOCATION APPARATUS 
INCLUDING RECORDING FUNCTION AND DATA CARTRIDGE 



Inventor: Tom Musolf 

447 Mountain View Ave 
Mountain View, CA 94041 
Citizenship: US 

Rich Freeman 
1307 Crestview Drive 
San Carlos, CA 94070 
Citizenship: US 

Mike Much 
6408 Menlo Drive 
San Jose, CA 95120 
Citizenship: US 



Assignee: LeapFrog Enterprises, Inc. 

6401 Hollis Street, Suite 150 
Emeryville, CA, 94608-1070 

Entity: Large 



TOWNSEND and TOWNSEND and CREW LLP 
Two Embarcadero Center, 8 th Floor 
San Francisco, California 941 1 1-3834 
Tel: 415-576-0200 



PATENT 

Attorney Docket No.: 020824-0035 12US 
LeapFrog Docket No. 157.01 

ELECTROGRAPHIC POSITION LOCATION APPARATUS 
INCLUDING RECORDING CAPABILITY AND DATA CARTRIDGE 

INCLUDING MICROPHONE 

CROSS-REFERENCES TO RELATED APPLICATIONS 

5 [0001] This patent application is a non-provisional of and claims the benefit of the 

filing date of U.S. Provisional Patent Application No. 60/512,275, filed on October 17, 2003, 
U.S. Provisional Patent Application No. 60/487,440, filed on July 14, 2003, and U.S. 
Provisional Patent Application No. 60/437,770, filed on January 3, 2003. All of these U.S. 
Provisional Patent Applications are herein incorporated by reference in their entirety for all 
10 purposes. 

BACKGROUND OF THE INVENTION 

[0002] Electrographic position location apparatuses are known. One such apparatus 

was made by V-Tech and was called the Record 'n Learn Pad. This product had a pad and a 
pen. The pen was coupled to the pad with a cable. 

15 [0003] A book was disposed on the pad when the pad was in use. The pen was used 

to select words in the book. After selecting words, audio for the selected words could be 
heard through a speaker in the pad. The pad also had a separate microphone and record 
button. When a user depressed the record button, the user's voice was recorded. Recording 
was in progress when a red light on the pad illuminated. To play back the recorded voice, the 

20 user could press a play button on the pad or select a "play" icon in the book with the pen. 

[0004] While the above described electrographic position location apparatus is useful, 

a number of improvements can be made. For example, in the above-described apparatus, a 
user could only record a voice and then play it back. There was no ability to integrate the 
user's voice into a unique passage such as a story or into a game. Accordingly, the apparatus 

25 did not use the user's voice in a manner, which was interesting to the user. 

[0005] In addition, the microphone and the record button in the Record 'n Learn Pad 

were physically integrated into the pad in a manner that made the microphone difficult to use. 
The microphone was located in a position flush with the surface of the platform so a user 
tended to bend down and speak with his or her mouth near the platform surface. This 

30 recording position is physically awkward for the user and results in poor recording quality 



because frequently the user is either to close or too far away from the microphone and the 
user's diction is compromised by the physically awkward position. 

[0006] Also, in some instances, the user may not want to use the microphone and may 

simply want to use the apparatus to electronically read a book without using the record 
5 function. If the user does not want to use the record function, the bulky microphone- 
containing apparatus must still be used. In some circumstances, it would be more desirable if 
the user had the ability to choose whether or not to use a microphone with the above- 
described pad. 

[0007] Other toys have allowed a child to record his or her name, and then hear his or 

10 her name played back when the toy is first used. For example, after recording his voice, a toy 
may say start a play process by saying "Hi (name)! Let's play". However, although such toys 
can intersperse preprogrammed audio with user-recorded words, the level of interaction is 
limited. It would also be desirable if a user could interact with a toy to a greater extent and in 
a more interesting way than just using the user's name. It would be desirable if the user 
15 could hear his or her voice along with pre-recorded audio, for example, in a story or game. 
[0008] Embodiments of the invention address these and other problems, individually 

and collectively. 



SUMMARY OF THE INVENTION 

20 [0009] Embodiments of the invention are directed to data cartridges including 

microphones, electrographic position location apparatuses including data cartridges with 
microphones, and electrographic position location apparatuses including unique recording 
functions. Kits including the data cartridges and print media are also disclosed. 
[0010] One embodiment of the invention is directed to a data cartridge comprising: 

25 (a) a body; (b) a memory device in the body; (c) a connector extending from the body and 
coupled to the memory device; and (d) a microphone attached to or incorporated within the 
body. 

[0011] Another embodiment of the invention is directed to a data cartridge 

comprising: (a) a plastic body; (b) a connector extending from the body; (c) a first memory 
30 device in the body storing code for audio outputs for print elements in a print medium; (d) a 
microprocessor in the body; (e) a microphone electrically coupled to the microprocessor; (f) a 
connector extending from the body and coupled to the memory device and the 
microprocessor; (g) a second memory device coupled to the microprocessor, wherein the 
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second memory device is adapted to store code for the user's voice; (h) a dummy microphone 
including a head portion and a neck, wherein the neck is coupled to the body; and (i) an 
illumination source in the head portion of the dummy microphone, and being electrically 
coupled to the microprocessor. 
5 [0012] Another embodiment of the invention is directed to an electrographic position 

location apparatus comprising: (a) a platform including a first connector and a surface, the 
surface capable of receiving a print medium; (b) a data cartridge comprising (i) a body, (ii) a 
memory device in the body, (iii) a second connector extending from the body and coupled to 
the memory device, and (iv) a microphone attached to or incorporated within the body, 

10 wherein the first and second connectors are connectable to each other. 

[0013] Another embodiment of the invention is directed to an electrographic position 

location apparatus comprising: (a) a platform comprising a surface; (b) a print medium 
suitable for placement on the surface, wherein the print medium comprises a record print 
element and a playback print element, wherein the playback print element is present along 

15 with other print elements that together are used to form a unique passage, wherein the unique 
passage is used in a story or a game; (c) a plurality of electrical elements in the platform and 
under the surface; (d) a microprocessor coupled to the plurality of electrical elements; (e) a 
memory device coupled to the microprocessor, wherein the memory device comprises code 
for recording a user's voice, code for storing the user's recorded voice, code for playing back 

20 the user's voice, and code for providing sounds associated with the other print elements; and 
(f) an audio output device coupled to the microprocessor. 

[0014] Another embodiment of the invention is directed to a kit for use in an 

electrographic position location apparatus, the kit comprising: (a) a print medium including a 
record print element; (b) a data cartridge including (i) a body, (ii) a memory device in the 
25 body, (iii) a connector extending from the body and coupled to the memory device, and (iv) a 
microphone attached to or incorporated within the body. 

[0015] Another embodiment of the invention is directed to a method of interacting 

with a print medium, the method comprising: (a) placing a print medium on a platform 
including a surface, a plurality of electrical elements under the surface, and a speaker, 
30 wherein the print medium comprises a record print element, a playback print element, and 
additional print elements; (b) selecting the record print element; (c) speaking into a 
microphone to record a voice; (d) selecting the playback print element, wherein the playback 
print element causes a speaker in the platform to play back the user's voice along with audio 
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corresponding to the additional print elements. The audio corresponding to the print elements 
and the user's recorded voice may be used in a story or a game. 

[0016] Yet another embodiment of the invention is directed to a data cartridge 

comprising: (a) a body; (b) a first connector extending from the body; (c) a second connector 
5 extending from the body; (d) a microphone attached to or incorporated within the body; and 
(e) a memory device coupled to the second connector, wherein the first connector is for 
connecting the data cartridge to an external connector. 

[0017] Another embodiment of the invention is directed to an electro graphic position 

location apparatus comprising: (a) a platform comprising a surface; (b) a print medium 

10 including a print element, wherein the print medium is capable of being received on the 
platform; (c) a plurality of electrical elements in the platform and under the surface; (d) a 
microprocessor coupled to the plurality of electrical elements; (e) a memory device coupled 
to the microprocessor, wherein the memory device comprises code for recording a user's 
voice, code for storing the user's recorded voice, and code for playing back the user's voice; 

15 (f) an audio output device coupled to the microprocessor; and (g) a microphone structure 
coupled to the housing, wherein the microphone structure comprises a head portion and a 
neck. 

[0018] Another embodiment of the invention is directed to a toy comprising: (a) a 

housing having a display screen; (b) a plurality of electrical elements in the housing and 

20 under the display screen; (d) a microprocessor coupled to the plurality of electrical elements; 
(e) a memory device coupled to the microprocessor, wherein the memory device comprises 
code for recording a user's voice, code for storing the user's recorded voice, code for playing 
back the user's voice, and code for generating one or more images on the display screen; (f) 
an audio output device coupled to the microprocessor; and (g) a microphone structure 

25 coupled to the housing, wherein the microphone structure comprises a head portion and a 
neck. 

[0019] These and other embodiments of the invention are described in further detail 

below in the Detailed Description with reference to the Figures. 

30 BRIEF DESCRIPTION OF THE DRAWINGS 

[0020] FIG. 1(a) shows a data cartridge including a microphone according to an 

embodiment of the invention from a front view. 
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[0021] FIG. 1(b) shows the data cartridge including the microphone show in FIG. 1(a) 

from the side. 

[0022] FIG. 1(c) shows an electrographic position location apparatus including the 

data cartridge shown in FIG. 1(a). 
5 [0023] FIG. 2(a) shows an exploded view of a portion of the data cartridge from a top 

perspective view. 

[0024] FIG. 2(b) shows an exploded view of a portion of the data cartridge from a 

bottom perspective view. 

[0025] FIG. 3 shows a perspective view of a data cartridge including two parts 

10 including a microphone part and a memory structure part. 

[0026] FIG. 4 shows a block diagram of some components of the data cartridge. 

[0027] FIG. 5 shows an exemplary electrical schematic diagram for a data cartridge 

embodiment. 

[0028] FIG. 6 shows a perspective view of an electrographic position location 

1 5 apparatus including a book and a data cartridge including a microphone. 

[0029] FIG. 7 shows a page in a book including record print elements. 

[0030] FIGS. 8(a)-8(c) shows pages in a book including record print elements, 

playback print elements, and other print elements. 

[0031] FIG. 9 shows a block diagram of some electrical components in an 

20 electrographic position location apparatus. 

[0032] FIG. 10 shows a perspective view of an electrographic position location 

apparatus without a data cartridge, wherein a dummy microphone is coupled to a platform of 
an electrographic position location apparatus. 

[0033] In the Figures, like numerals designate like elements. 

25 

DETAILED DESCRIPTION 

[0034] Some embodiments of the invention are directed to a data cartridge including a 

microphone. The data cartridge can be used with a platform in an electrographic position 
location apparatus. The electrographic position location apparatus can provide unique 
30 recording functions. Kits including the data cartridges with print media suitable for use with 
an electrographic position location apparatus are also disclosed. 

[0035] I. Data Cartridges Including Microphones 
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[0036] Some embodiments of the invention are directed to data cartridges including 

microphones. As used herein, the term "data cartridge" includes any suitable structure or 
combination of structures including a memory device. A "data cartridge" according to 
embodiments of the invention can be of one-piece construction, or can include multiple parts, 
5 which may or may not be separable from each other. The data cartridge provides additional 
data to an external device through an external connector. A data cartridge generally does not 
have a visual output device such as a display screen or an audio output device such as a 
speaker. For example, in one embodiment, the data cartridge comprises a body. A memory 
device is in the body or is attached to the body. A connector extends from the body and is 
10 coupled to the memory device. A microphone is attached to or incorporated within the body. 
The microphone may be inside or outside of the body. Various examples of data cartridges 
according to embodiments of the invention are described below. 

[0037] The data cartridges according to embodiments of the invention can be used 

with any suitable external device. The external device generally has greater processing 

15 power and has greater functionality than the data cartridge. For example, in some 

embodiments, the external device may be a platform that receives a print medium. As will be 
explained in further detail below, the platform may contain an array of electrical elements 
that correspond with particular x-y positions. The data cartridge may store code for audio 
outputs that correspond to those x-y positions and also corresponding x-y positions in the 

20 print medium on the platform. When a user selects a particular print element associated with 
a particular x-y position in a print medium when it is on the platform, an audio output 
associated with the print element can sound from a speaker in the platform. 
[0038] The data cartridge can be coupled to the platform or uncoupled from the 

above-described platform through a pair of connectors. Together, the data cartridge and the 

25 platform may form an electrographic position location apparatus. Further details about 
electrographic position location apparatuses are provided below. 

[0039] Although the description herein discusses the use of a data cartridge with an 

external device in the form of a platform, it is understood that other external devices can be 
used in embodiments of the invention. Such external devices may include toys and dolls that 
30 include a connector for connecting to the connector in the data cartridge. Some external 
devices are described in U.S. Patent Application Nos. 60/446,829, filed on February 10, 
2003, and 60/512,326, each of which is entitled "Interactive Hand Held Apparatus With 
Stylus" (Attorney Docket Nos. 020824-004 100US and 020824-0041 10US). These 
applications are herein incorporated by reference in their entirety for all purposes. In these 
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applications, gaming apparatus embodiments are disclosed. These gaming apparatuses 
include a housing and a display screen. An array of electrical elements is under the display 
screen. A directional button and a stylus are coupled to the housing to allow a user to input 
data while looking at the display screen. In addition to these components, the gaming 
5 apparatuses may include a processor, a memory unit, and a speaker. The memory unit may 
comprise code for educational games and the educational games may be developed using a 
vector-graphics based animation program such as Macromedia Flash™. 
[0040] FIG. 1(a) shows a data cartridge 100 according to an embodiment of the 

invention. As shown in FIG. 1(a), the data cartridge 100 includes a body 120. The body 120 
10 may comprise plastic and may have a recess 122. A connector 124 is in the recess 122. The 
portions of the body 120 defining the recess 122 protect the connector 124 from potential 
damage. In other embodiments, the connector 124 can extend from the body 120, without 
being in the recess 122. 

[0041] The body 120 of the data cartridge 100 may have any suitable geometry. In 

15 this example, the body 120 has a square shape, but could be shaped other ways in other 

embodiments of the invention. In FIG. 1(a), a microphone (not shown) is inside of the body 
120 and holes 126 are provided in the body 120 so that a user can speak into the microphone 
inside of the body 120. 

[0042] In the data cartridge 100, a dummy microphone structure 110 is coupled to the 

20 body 120. The dummy microphone structure 110 includes a neck 118 and a head portion 
112. The neck 118 is between a head portion 112 and the body 120. 

[0043] The head portion 112 includes an illumination source 102 that is an LED (light 

emitting diode). The illumination source 102 could alternatively be a light bulb or other 
illumination source that provides light. The illumination source 102 may be used to inform 
25 the user about a particular event in the recording process. For example, the illumination 

source 102 may light up when the user is supposed to speak into the microphone (to prompt 
the user to speak). The illumination source 102 may turn off after the user is done recording 
the user's voice. 

[0044] The illumination source 102 is electrically coupled to electronics inside of the 

30 body 120 via a thick wire (not shown) inside of the neck 118. The thick wire may be a 

copper wire that has a "memory" associated with it. For example, the thick wire may have a 
diameter of about 1 mm or more. That is, the wire is thick enough so that when the neck 118 
is bent by a user, the neck 118 retains the form that it obtained after bending. This reduces 
the chance that the data cartridge 100 will separate from an external device such as an 
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electronic platform if the user manipulates the dummy microphone structure. If the wire in 
the neck 118 is too rigid, then the movement of the neck 118 may cause the body 120 to 
separate from an external device such as the above-described electronic platform. 
[0045] The user may not know when recording is actually being performed. The 

5 illumination source 102 can indicate to the user when the recording electronics are waiting 
for the user to record something, and when the recording electronics are actually recording. 
When the recording electronics wait for a signal, the illumination source 102 can blink on and 
off. Once a recording threshold is crossed (this is explained in detail below) and recording is 
actually being performed, the illumination source 102 remains on and does not blink. Once a 
10 predetermined amount of record time passes, the illumination source 102 turns off, indicating 
to the user that recording is complete. This shows that different visual cues can be given to 
indicate to the user that the apparatus is waiting for the user to speak, is recording, or is not 
recording. 

[0046] Providing the dummy microphone structure 110 and the real microphone 

15 inside of the body 120 has a number of advantages. First, the dummy microphone structure 
110 spaces the user's mouth an appropriate distance from the real microphone inside of the 
body 120. When multiple recordings are made over time, each recorded voice can have 
substantially the same volume. Second, children, in particular, may want to grab the neck 
118 and/or the head portion 110 to manipulate the microphone. If the dummy microphone 

20 structure 110 used a real microphone, the repeated grabbing of the neck 118 and/or head 

portion 110 could cause thin wires inside of the neck 118 to separate from electronics inside 
of the body 120, thus rendering the real microphone inoperative. In the illustrated 
embodiment, there is at least one thick conductive wire inside of the neck 118 so that 
electricity is supplied to the illumination source 102. Since the conductive wire is thick (e.g., 

25 1 mm in diameter or more), it is not likely to break. Furthermore, even if the thick 

conductive wire does break, the illumination source 102 would be the only device that would 
be rendered inoperative. The microphone inside of the body and under the microphone holes 
126 would still function under these circumstances. Third, having the real microphone inside 
of the body 120 reduces the amount of noise that is generated, compared to having a real 

30 microphone in the dummy microphone structure 110. If a microphone moves back and forth 
during use, air moving through the microphone may create noise in any recording that is 
made. In the illustrated embodiment, the real microphone is in the body 120 and remains 
stationary when the data cartridge 100 is coupled to an external device. The real microphone 
remains stationary even though the user grabs or otherwise manipulates the dummy 



microphone structure 110. The real microphone does not move (or does not move very 
much) so that the creation of noise is minimized. Fourth, while the dummy microphone 
structure could be omitted in some embodiments, children enjoy pretending that they are 
speaking into a microphone. This makes embodiments of the invention more fun and 
5 interactive than conventional electrographic position location apparatuses. 

[0047] Although the use of a dummy microphone is described above for use in a data 

cartridge, it could alternatively be attached to a platform in an electrographic position 
location apparatus in other embodiments of the invention. 

[0048] FIG. 1(b) shows the data cartridge 100 shown in FIG. 1(a) from a side view. 

10 As shown in FIG. 1(b), the side of the data cartridge 100 has a release member 130. Another 
release member (not shown) can be on the opposite side of the body 120. The release 
member 130 may be in the form of a depressible button. When the release member 130 is 
depressed, clamp members coupled to the release member 130 disengage a connector in an 
external device (not shown). As will be explained in further detail below, the clamp 

15 members further secure the data cartridge 100 to the external device to inhibit the easy 
withdrawal of the data cartridge 100 from the connector in the external device. 
[0049] FIG. 1(c) shows an electrographic position location apparatus 200 including 

the data cartridge 100 coupled to an external device such as a platform 210. In this example, 
the platform 210 is foldable, and includes a major surface 214 and a hinge 216. The hinge 

20 216 allows the platform 210 to fold upon itself when the platform 210 is not in use. As 

shown, a stylus 202 is coupled to the platform 210 through a cable 201. A speaker 218 and 
an on/off button are in the platform 210. The operation of an electrographic position location 
apparatus 200 of the type shown in FIG. 1(c) is described in further detail below. 
[0050] FIG. 2(a) shows an exploded view of part of a data cartridge according to an 

25 embodiment of the invention. In FIG. 2(a), the data cartridge includes upper and lower body 
portions 120(a), 120(b) forming the body 120. A label 330 is on the upper body portion 
120(a) to identify the type of data present in the data cartridge. 

[0051] A printed circuit board 320 is between the two body portions 120(a), 120(b) 

and is coupled thereto. The printed circuit board 320 has the connector 124, which is formed 
30 as conductive traces on the circuit board edge region. In other embodiments, conductive pins 
or holes could be used to form the connector 124 (e.g., an RS-232 connector). 
[0052] A microphone 325 is mounted to the printed circuit board 320 and may be 

electrically coupled to the connector 124 {e.g., through a microprocessor). For simplicity of 
illustration, the circuit lines in the circuit board are not shown. A battery 314 is under the 
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printed circuit board 320 and provides power to one or more SRAM (static random access 
memory) chips (not shown) inside of the body 120. The SRAM chips may be coupled to the 
microprocessor (not shown in FIG. 2) and may be used to store the user's recorded voice. A 
battery door 312 is coupled to the bottom housing 120(b) so that the user can replace the 
5 battery 314 if it runs out of power. 

[0053] Release members 130 are coupled to the body 120. The release members 130 

are outwardly biased by a torsion spring 326. The release members 130 can actuate sheet 
metal lever arms 310 when they are forced inward. Sheet metal lever arms 310 are coupled 
to joining members 316, which contain two clamp members 318 in the form of metal pins 

10 that are directed toward each other. In the absence of inward pressure on the release 

members 130, the clamp members 318 are inwardly biased to clamp onto a connector (not 
shown in FIG. 2) in an external device. When pressure is applied to the release members 
130, the inward pressure on the clamp members 318 is reduced. The data cartridge is then 
easier to separate from the connector on the external device since the clamp members 318 do 

15 not clamp down on the connector. The gripping force provided by the clamp members 318 to 
the connector may be at least about twice the gripping force provided by the connection of 
the connector 124 to another connector on the external device. 

[0054] FIG. 2(b) shows a bottom view of the part of the data cartridge shown in FIG. 

2(a). In FIG. 2(b), like numerals designate like elements as shown in FIG. 2(a). In FIG. 2(b), 
20 the underside of the printed circuit board 320 is shown more clearly. The printed circuit 
board 320 has a vertical conductive path that allows the battery 314 to supply power to the 
LED in the head portion via the conductive wire in the neck 118. 

[0055] FIG. 3 shows another data cartridge 500 according to an embodiment of the 

invention. In this example, the data cartridge 500 has a two-piece construction including a 
25 first part 504 and a second part 506. The first part 504 may include a memory device such as 
a ROM and may be separable from the first part 504. The first part 504 may include an 
internal microphone, recording electronics, and the dummy microphone structure described 
above and below. 

[0056] The embodiment in FIG. 3 allows a user to use the first part 504 with different 

30 second parts with respectively different memory devices containing respectively different 
stories, games, etc. This advantageously allows a user to use one microphone with different 
memory devices. 

[0057] FIG. 4 shows a block diagram of some electrical components in a data 

cartridge (and/or electrographic position location apparatus) according to an embodiment of 
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the invention. FIG. 4 shows a microprocessor 24 coupled to an interface 28, which is in turn 
coupled to a connector 40 such as an edge connector. A microphone 17 and an LED 18 are 
electrically coupled to the microprocessor 24. One or more SRAM chips 16 (or other 
memory device) and a battery 14 are also electrically coupled to the microprocessor 24. A 
5 ROM 29 (or other memory device) is also in communication with the connector 40. 

[0058] As illustrated by FIG. 4, the data cartridge may include one or more memory 

devices, which may store code for audio or visual outputs associated with various print 
elements in a print medium such as a book, and/or code for the user's voice. The audio or 
visual outputs may include jokes, questions, words, phrases, letters, facts, music, etc. 

10 Operational code, such as code for prompting the user to record the user's voice, code for 

playing back the user's voice via an audio output device, code for sounding out pre-recorded 
audio sequences, etc. may be in the one or more memory devices. Code for performing any 
other function described herein can be stored in the one or more memory devices. 
[0059] The one or more memory devices may comprise any suitable combination of 

15 ROMs, RAMs, SRAMs, EEPROMs, and EPROMs. For example, in FIG. 4, the ROM 29 
may be a first memory device and may store code for audio for various print elements in a 
print medium, while the SRAM 16 may be a second memory device, which stores the user's 
recorded voice. In preferred embodiments, the ROM 29 stores audio data for at least two 
children's books. Although the ROM 29 and SRAM 16 can be first and second memory 

20 devices that are embodied by different memory chips, it is understood that the one or more 

memory devices in embodiments of the invention could be present on the same chip or on the 

s 

same circuit board. 

[0060] The user may use the above-described data cartridge in an electrographic 

position location apparatus. During use, the user may record certain information such as the 

25 user's name, the user's favorite food, the user's favorite toy, etc. in the data cartridge. This 
information can be stored in the SRAM 16 even after the electrographic position location 
apparatus is turned off. This can be desirable if, for example, the user is playing a game or 
reading a story in a book on a platform in the electrographic position location apparatus. The 
SRAM can store previously recorded information so that the user can pick up where the user 

30 left off at a later time. When the user uses the electrographic position location at a later time, 
the electrographic position location apparatus can remember the user's name and can 
automatically announce the user's name to the user. 

[0061] Illustratively, as will be described in further detail below, a user may record 

user generated information such as the user's name, the user's favorite food, and the user's 

11 



favorite animal using the data cartridge. This user-generated information may be played back 
to the user along with pre-recorded audio for words in a story or in a game. When the 
pre-recorded audio is played back to the user with the user-recorded information in a story, 
the story is personalized to the particular user. If the user decides to play back only part of 
5 the story, the user can come back at a later time to play back the rest of the story since the 
user-recorded information is stored in the data cartridge. Also, the data cartridge can store 
the user's name so that the user is greeted each time with the user's recorded name each time 
that data cartridge is used. 

[0062] FIG. 5 shows an electrical circuit diagram according to an embodiment of the 

10 invention. Those of ordinary skill in the art can implement other circuits. In this example, 
the microprocessor 24 is a Sunplus SPCR02A chip, and two Sunplus SPRS512C SRAM 
chips 16 are electrically coupled to the microprocessor 24. These chips are commercially 
available from Sunplus Technologies. A lithium battery 14 supplies power to the SRAM 
chips 16. A microphone 17 is coupled to the microprocessor 24, via microphone pre- 
15 amplifier circuit 38. The previously described interface 28 in this example is provided by an 
input buffer 28(a) and an output buffer 28(b). An address decoding circuit 48 is coupled to 
the input and output buffers 28(a), 28(b). The microprocessor 24 is electrically coupled to 
the connector 40. A separate ROM chip 29 is separately coupled to the connector 40. The 
ROM chip 29 and the microprocessor 24 can communicate with a second microprocessor in 
20 an external device (not shown in FIG. 5), which has a connector, which is connectable to the 
connector 40. The second microprocessor (not shown in FIG. 5) can retrieve data from the 
ROM chip 29 and can provide instructions to the microprocessor 24. 

[0063] II. Electrographic Position Location Apparatuses 

[0064] Embodiments of the invention are also directed to electrographic position 

25 location apparatuses including recording capability. One embodiment of the invention is 

directed to an electrographic position location apparatus that includes a platform including a 
first connector and a surface. The surface is capable of receiving a print medium. A data 
cartridge connectable to the platform has (i) a body, (ii) a memory device in the body, (iii) a 
second connector extending from the body and coupled to the memory device, and (iv) a 
30 microphone attached to or incorporated within the body. The first and second connectors are 
connectable to each other so that the data cartridge and the platform can be coupled and 
uncoupled together by the user. Other embodiments do not need to use a data cartridge. 

12 



[0065] Suitable platforms and associated electronics for electrographic position 

location apparatuses are described in U.S. Patent Nos. 5,575,659, 6,661,405 and 6,668,156. 
All of these patents are assigned to the same assignee as the present application and are 
incorporated herein by reference in their entirety for all purposes. These patents and patent 
5 applications include descriptions of a platform including electrical elements and a stylus 
including another electrical element coupled to the platform. The electrical elements can be 
signal transmitting elements or signal receiving elements. In one example, the stylus coupled 
to the platform includes a receiving antenna. When the stylus is positioned over a book on 
the major surface of the platform, the stylus receives a signal that is particular for the 

1 0 electrical element under the stylus. A microprocessor in the platform can determine the 

position of the stylus relative to the major surface. The stylus could be used to interact with 
print elements in the book. As described in U.S. Patent No. 6,608,618 and U.S. Patent 
Application No. 10/457,981, filed on June 9, 2003, the stylus may also include a writing 
element such as a pencil lead, a pen, or a crayon. In use, a user may select a print element 

15 such as a word in the book and a speech synthesizer in the platform may sound out the 
selected word. In other examples, the stylus may transmit a signal to electrical elements 
under the surface of the platform instead of receive them. 

[0066] Other electrographic position location apparatuses are described in U.S. Patent 

Nos. 6,641,401 and 6,608,618. In these electrographic position location apparatuses, the 

20 electrical elements under the surface of the platform are pressure switches. 

[0067] The surface of the platform is suitable for receiving a print medium such as a 

sheet of paper, a card, a template, or a book. The book or the sheet of paper would include 
print elements such as words, letters, pictures, etc., which can be selected by the user. 
[0068] The book may teach the user about any suitable subject including, but not 

25 limited to reading, math, writing, phonics, letter recognition, history, geography, and social 
studies. The book may also contain stories, games, or puzzles. 

[0069] The print medium may include various print elements. The print elements 

may be icons, words, symbols, etc. The print elements may be selected to provide some 
audio feedback. For example, a print element may be the word "cat", and the selection of the 
30 word will cause the apparatus to say that word. Other print elements may be selected to 
change the function of the electrographic position location apparatus. For example, 
functional print elements may include record print elements, playback print elements, page 
indicator print elements, volume control print elements, game print elements, music print 
elements, stop print elements, etc. Other print elements are described below. 
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[0070] In some embodiments, the various the print elements can be over a plurality of 

electrical elements including a first electrical element and a second electrical element (e.g., 
transmitting fingers or pressure switches). The plurality of electrical elements can be under a 
surface of a platform. A book including a record print element and a playback print element 
5 may be on the surface. In an illustrative example of how the record print element and the 
playback print element could be used, the first electrical element (e.g., a conductive finger 
that transmits a unique electromagnetic signal) can be under the record print element and the 
second electrical element can be under the playback print element. A playback print element 
may be a narrative print element which, when selected, will play back a narrative including 

10 user recorded and non-user recorded audio. A playback print element may also be a single 
icon that has the same form as the record print element so that the user knows that the record 
and playback print elements will have the same audio associated with them. However, the 
record print element (or the playback print element) may have another indicator such as a red 
dot associated with it to indicate to a user that it is different from a corresponding playback 

15 print element. Other electrical elements can be present under other print elements. When a 
user interacts with the record print element and consequently with the first electrical element, 
a signal can be sent to the microprocessor in the data cartridge to being recording. A light in 
the platform or in the data cartridge (as described above) may light up to prompt the user to 
record the user's voice. When a user interacts with a playback print element and 

20 consequently with the second electrical element, a signal can be sent to the microprocessor in 
the data cartridge to play back the stored recorded sound. 

[0071] FIG. 6 shows an electro graphic position location apparatus 500 including a 

platform 210 including a surface, and a data cartridge 100 coupled to the platform 210. The 
data cartridge 100 may have the features described above. A stylus 422 is coupled to the 
25 platform 210. As shown in FIG. 6, the platform 210 is free of record or playback buttons so 
that it can be made smaller and less expensively than platforms with record and playback 
buttons. 

[0072] A print medium 400 has been placed on the surface of the platform 210 by a 

user. The print medium 400 is in the form of a book with a spiral spine, but could be a book 
30 with a ring spine or a sheet of paper in other embodiments. 

[0073] Various print elements may be included in the print medium 400. The print 

medium 400 includes a page indicator print element 422 in the form of a "Go" circle, and a 
stop print element 424. The user may use the stylus to select the page indicator print element 
422 to indicate to the electronics inside of the platform 210 which pages are currently being 
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displayed to the user. The user may select the stop print element 424 with the stylus to stop 
whatever the user is currently doing. 

[0074] Other print elements including a music print element 436 in the form of a 

musical note, a repeat question print element 434, a game print element 432, and volume 
5 control print elements 430 may be provided in the print medium. The music print element 
436 may be selected to put the apparatus 500 in a "music mode" so that the selection of 
various print elements will cause the apparatus 500 to play music. The repeat question print 
element 434 may be selected by a user to repeat a question posed by the apparatus 500. The 
game print element 432 may be selected by the user to cause the apparatus to play a game. 
10 The volume control print elements 430 may be selected by the user to increase or decrease 
the volume of the apparatus 500. 

[0075] Other print elements include a record print element 420 in the form of a red 

button. When a user selects this, the user can record his voice. If the user needs to re-record 
his voice, then the record print element 420 can be selected again. 

15 [0076] FIG. 7 shows a page (i.e., a main record page) in the print medium 400 

wherein a user can record the user's voice in response to various questions posed by the 
apparatus. For example, the illustrated fortuneteller may be called "Franny". Franny may 
ask the user to touch all of the red circles on the page to see what the future holds. After 
selecting the red dot print element 452 under the "Name" print element on the illustrated 

20 page, the apparatus may prompt the user and say, "What is your name?" A "beep" sound 

may sound from the speaker to prompt the user to state the user's name. If the user does not 
speak loudly enough, the apparatus may say, "I'm a bit hard of hearing, can you please say it 
again?" Another "beep" may sound and the user may try and record the user's voice again. 
Then, as a confirmation, the apparatus may say, "Well hello (name), I'm Franny, nice to meet 

25 you." Once recorded, the user's name can remain in an SRAM chip (or other memory 

component) in a memory device in the data cartridge (or in the platform). A similar type of 
recording process can be used to record the user's age, friend, color, animal, and food. 
[0077] After recording the user's name, age, friend, color, animal, and food, this 

recorded information can be used in a story. As used herein, the term "story" includes 

30 poems, rhymes, and narratives about fictitious or real characters, people, places, things, etc. 
Alternatively, the recorded information could be used in a game. In a game, the apparatus 
may ask a question. After selecting a print element as an answer to the question, the user's 
previously recorded voice for that print element can be played. The recorded information 
may be interspersed with pre-recorded audio segments for other print elements such words, 
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pictures, etc. in the book. The other print elements that are not associated with the record 
print elements could also be selectable so that audio related to these other print elements 
could also by played. 

[0078] Illustratively, as shown in FIG. 8(a), a narrative print element 461 can be 

5 selected by a user to read a story passage in the narrative 450. When the narrative passage 
450 is read to the user, the user's recorded voice for the user's favorite animal (e.g., a bear) 
will sound between the sounds of the pre-recorded words "Hey" and "It's" as shown by the 
print element 452 in the form of a turtle (which represents the user's favorite animal). The 
resulting narrative is unique to the user and makes the interaction with the print medium 100 
10 fun and interactive. The user may alternatively select the print element 452 in the form of a 
turtle directly to hear the user's recorded voice reciting the user's favorite animal. Other 
words such as "Hey" and "It's" are also selectable. For example, if the user selects the word 
"Hey", the word "hey" will sound from a speaker. 

[0079] Favorite name and favorite animal print elements are also shown at the bottom 

15 of the left page. The user may select the shown dots to start the above-described recording 
process in case the user has changed the user's mind about the user's favorite animal. The 
same recording process as described above can be used. 

[0080] In FIG. 8(a), other print elements are present. FIG. 8(a) shows a print element 

in the form of a bear with a first record print element 420(a) associated with it. FIG. 8 also 
20 shows a print element in the form of an elephant with a second record print element 420(b). 
In some embodiments, the user may select the print elements 420(a), 420(b) and the 
apparatus may prompt the user to make a bear or elephant sound. The same recording 
process as described above can be used. 

[0081] Also in FIG. 8(a), at the bottom of the shown pages, there are additional 

25 record print elements 451, 453 associated with recording the user's name and associated with 
recording the name of the user's favorite animal. Although these were presented before on 
the main record page shown in FIG. 7, these additional record print elements can be provided 
in case the user wants to change the recorded information associated with the current pages 
that are being viewed. 

30 [0082] A game print element 455 is also shown in FIG. 8(a). The game print element 

455 allows a user to play a game with the user's recorded audio. For example, after selecting 
the game print element 455, a synthesized voice may ask "Can you find the lion, and then the 
bear?" After selecting the image of the lion, the user's previously recorded lion roar can 
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sound. After selecting the image of the bear, the user's previously recorded bear growl can 
sound, and the synthesized voice may then provide a reward output such as "Good job!" 
[0083] FIG. 8(b) shows two additional pages of a book that can be used with the 

electrographic position location apparatus. This set of pages illustrates a play pattern 
5 whereby the user can create his or her own stories with unique endings. As shown, a child 
can select the "Little Miss Muffet" story and a synthesized voice can read the words of the 
story. When the words reach the last panel of the 3 -panel story, the synthesized voice may 
prompt the user to record the ending of the story by selecting the record button 886. The user 
then records a unique ending to the story (as described above) and can then select the "hear 

10 my story" print element 888 to hear the user's recorded ending to the story. 

[0084] The embodiment shown in FIG. 8(b) is advantageous. Allowing a user to 

complete a story using his or her recorded voice allows the user to be creative and to learn 
how to describe things that the user sees. In addition, hearing the user's own voice reinforces 
the story-creating experience in the user. 

1 5 [0085] FIG. 8(c) shows another pair of pages that can be in a book that can be used 

with the electrographic position location apparatus. This pair of pages contains different 
images associated with different countries. As shown, there are a number of record print 
elements 520, 521 in the form of dots. Selecting a dot will allow a user to record his or her 
voice for the particular image associated with the selected dot. For instance, after selecting 

20 the dot 521 a synthesized voice may say "'Ni hao from China, my name is Mei Lin.' To say 
hello to Mei Lin, say 'Ni hao'." Then, the user can say the phrase "Ni hao" into the 
microphone of the electrographic position location apparatus. After selecting the image of 
the girl associated with the dot 521, the user's recorded voice saying "Ni hao ma?" can be 
played for the user. 

25 [0086] After selecting a game print element 555, the user can play a language game. 

For example, a synthesized voice may say, "We need photos. Select as many photos as you 
can. Here, they say 'Ni hao'". The user can then select the picture above word "China" and 
can hear the user's previously recorded voice saying "Ni hao." Then voice can then say, 
"Here, they say 'Bon jour'". The user can then select the picture above the word "France", 

30 and the user can hear the user's previously recorded voice saying "Bon jour." 

[0087] The embodiment shown in FIG. 8(c) has a number of advantages, since 

different languages are being taught. By recording the user's voice, the user can practice 
speaking a foreign language and can hear the user's voice. After hearing the user's voice, the 
user can compare it to the correct pronunciations for the spoken words by listening to both 
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sounds. The pronunciations of the words (and also the meanings of the words) are reinforced 
in a way that cannot be done using, for example, a tape recorder and a book. In addition, 
selecting images associated with the spoken words also involves some kinesthetic action on 
the part of the user and this also helps the user retain information and learn. All of this can be 
5 done without the need for a human tutor. Thus, embodiments of the invention are 
particularly desirable for teaching a person about foreign languages. 
[0088] Many other print elements and play patterns are described in the U.S. 

Provisional Patent Applications cited above. 

[0089] Although electrographic position location apparatuses with detachable 

10 memory cartridges are described in detail herein, it is understood that embodiments of the 

invention are not limited thereto. For example, the particular play patterns that are described 
with reference to FIGS. 7 and 8(a)-8(c) could be used in an electrographic position location 
apparatus without a detachable data cartridge including a microphone. For example, the 
books and play patterns described with reference to FIGS. 7 and 8(a)-8(c) could be used with 
15 a platform that supports a book or other print medium. The platform can include a 

microphone and optionally a dummy microphone (as described below). For example, in 
some embodiments, a platform may include a well for receiving a dummy microphone that 
"pops up" from the well and allows a child to pretend that he or she is speaking into the 
microphone. In this example, the real microphone may be present in the platform itself. In 
20 yet other embodiments, the electrographic position location apparatus may be in the form of a 
gaming apparatus (described above) where the microphone structure pops up from a housing 
of a hand-held gaming apparatus. 

[0090] Embodiments of the invention provide for a number of advantages. First, 

compared to conventional electrographic position location apparatuses, the electrographic 

25 position location apparatuses according to embodiments of the invention are more fun and 
interactive. As noted above, a user's recorded information can be interspersed with audio in 
a fun and interactive manner. Second, the data cartridge embodiments can be used with a 
platform in an electrographic position location apparatus that may not have been designed for 
recording capability. Accordingly, the embodiments including the data cartridge can 

30 advantageously provide the user with the option to record or not record the user's voice. 

Third, as shown in FIG. 6, the platforms in embodiments of the invention are free of record or 
playback buttons so that the platforms that are used in embodiments of the invention can be 
made smaller and less expensively than platforms with record and playback buttons. 
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[0091] Some embodiments of the invention are directed to kits including the above 

described data cartridges and the above described print media. Any of the above described 
data cartridges embodiments can be present with any number of type of the above-described 
print media without departing from the scope of the invention. The kits may also include a 
5 container, which contains the data cartridges and print media. The container may be a plastic 
container that contains the data cartridge and the print media together in package. The plastic 
container may be a molded relief package. 

[0092] A block diagram of some components of an electrographic position location 

apparatus is shown in FIG. 9. FIG. 9 is a schematic block diagram of the processor 60 and 

10 antenna elements 64, 66. Each first antenna element can include a number of conductive 
fingers, which may also be considered individual antennas in some embodiments. The 
processor 60 comprises a controller unit 120, transmitter logic 121 and a receiver unit 122. 
The processor 60 may include a signal driver and a signal processor. The controller unit 120 
is connected via the transmitter logic 121 to the first antenna elements 64, 66. The controller 

15 unit 120 is also connected via the receiver unit 122 via a wire 6 to a detection stylus 3. The 
transmitter logic 121 and receiver unit 122 are also connected to each other directly. The 
controller unit 120 is also connected to a headphone jack 37, a loudspeaker 61, a cartridge 
mating interface 62 (for the above described data cartridge) and an ON/OFF button 5. 
[0093] The ON/OFF button 5 can be pressed, and the controller unit 120, which 

20 causes the transmitter logic 121 to be activated, detects this event. The transmitter logic 121 
then applies electric signals to the electrical contacts 93, 94, 97, 98 of the first antenna 
elements 64, 66 in a sequence of frames. In these frames, each lasting approximately 3 
milliseconds, predetermined electrical signals are applied to the contacts 93, 94, 97, 98 of the 
transmitting antenna arrangements 62, 64. At the end of each frame, a different set of signals 

25 is then applied to the contacts 93, 94, 97, 98. 

[0094] In the course of a frame, an electromagnetic field is generated in the vicinity 

of the rectangular recesses in the upper sections in the housing portions of a platform. These 
electromagnetic fields induce voltage potentials in a brass ferrule in the detection stylus 3. 
This signal is then passed via the wire 6 to the receiver unit 122. In one example, the 

30 voltages applied to the contacts 93, 94, 97, 98 may range between plus three volts and minus 
three volts. The voltage induced within the brass ferrule can be about 0.5 millivolts. The 
receiver unit 122 then processes the induced voltage and a processed signal is then passed to 
the controller unit 120. 
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[0095] The controller unit 120 then converts the processed signals received from the 

receiver unit 122 into signals identifying the coordinates of the portion of the page of the 
book at which the detection stylus 3 is currently located. These coordinates are then used to 
select an appropriate sound stored within a sound memory either provided as part of the 
5 controller unit 120 or alternatively a sound memory provided as a memory chip within a 
cartridge inserted within the cartridge interface 62. The cartridge may be any of the above- 
described cartridges. The appropriate sound is then output via the loudspeaker 61 or to a set 
of headphones via the headphone jack 37. 

[0096] The processor in the platform of the electrographic position location apparatus 

10 may be embodied by or present in an application specific integrated circuit or ASIC. The 
ASIC used in the apparatus may not have the ability to record audio. The ASIC may not 
have the ability to import an audio signal from an external recorder chip and mix it with the 
ASIC based audio streams. 

[0097] An external mixer could be used to mix the audio outputs from the recorder 

1 5 chip and the ASIC into a single audio stream that could be sent to a speaker. However, there 
are some problems with this approach. First, the ASIC may use a direct digital drive audio 
output and the recorder chip may output an analog audio signal. Second, the resulting audio 
quality could go down, because an additional mix chip would be needed. Third, the 
apparatus cost would increase, because of the use of an additional mix chip. Fourth, software 
20 would have to be changed to control the audio output volume of the recorder chip output and 
the resulting mixed audio output. 

[0098] To address these problems, one could use the ASIC's ability to play back an 

audio stream read from its program/data storage area. Such data is conventionally stored in a 
memory device such as a ROM or flash chip. However, it is possible to interface the recorder 

25 . chip to the ASIC and have the ASIC pretend that the recorder chip is a memory device. The 
recorder chip presents its recorded data to the ASIC in response to the ASIC reading from 
what it believes is a memory device. The data is formatted by the recorder chip into a form 
expected by the ASIC. The ASIC can then internally mix this recorded audio with its other 
audio streams, thus sending out a single direct digital drive audio signal. The removes the 

30 need for an external audio mixer. The quality of the audio playback remains high, because 
sound signals are not fed through an additional audio component. 

[0099] To provide better sound quality, recording thresholds can be used. A record 

memory is typically divided into many buffers, each of which may be very short (e.g., 0.75 to 
2.0 seconds). Normally, when the microphone is turned on to record into a buffer, it takes the 
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user some amount of time to react to a prompt to start speaking. This delay is then recorded 
as silence into the buffer, essentially wasting buffer space. This extra silence also makes the 
playback of the buffer between other pieces of audio sound "choppy", because of this extra 
silence at the beginning. To address this problem, a recording threshold is used. When 
5 recording starts, the recording electronics wait for noise of certain level. When a certain 
threshold value is reached, the recording electronics start recording sounds into a buffer. 
Until that threshold is reached, the recording electronics are waiting for the user to record. 
This advantageously removes any silence from the beginning of a recording. 
[0100] If the user does not speak, the recording threshold may never be reached. A 

10 timeout feature can be used to address this problem. If the recording electronics have not 
detected noise exceeding the threshold by a certain amount of time, the recording is 
terminated and a special audio prompt can be given to the user. 

[0101] If the user stops speaking before the end of a buffer, there can be silence from 

that point to the end of the buffer. This trailing silence also can cause the playback of the 

15 buffer to sound choppy when other audio is played after such a buffer. To address this 

problem, a trailing silence threshold can be used. After the buffer is finished recording, the 
recording electronics review the recorded sound from the end of the buffer moving 
backwards. Sounds below the threshold are discarded and the end of the buffer is adjusted to 
be at the point of the last recorded sound above the threshold. 

20 [0102] In addition to the leading and trailing silence thresholds, during playback of a 

recorded buffer, it is possible to attenuate (fade in/out) the beginning and ending of recorded 
audio. This avoids large discontinuities (heard as "pops" in the audio playback) in sampled 
information. By applying a ramp up envelope to the beginning of the recording and a ramp 
down envelope to the ending, these distorted sounds can be eliminated. 

25 [0103] Recording thresholds and other functions such as attenuating sounds can be 

programmed into the apparatus by those of ordinary skill in the art. 
[0104] FIG. 10 shows a perspective view of an electro graphic position location 

apparatus without a data cartridge. A microphone structure 902 with a head portion and a 
neck is shown. In preferred embodiments, the microphone structure 902 is a dummy 

30 microphone structure with any of the features described above. An opening 904 for a 

microphone may be present near the base of the microphone structure 902. As shown, there 
is a recess that in the platform 900 that is cooperatively structured to receive the microphone 
structure 902, and the microphone structure 902 can "pop up" in some embodiments. 
Although the microphone structure 902 is directly coupled to the platform 900, the 
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advantages described above with respect to the dummy microphone are still applicable for 
this embodiment. For example, in comparison to the above-described Record 'n Leam Pad, 
the user's mouth will be spaced at a consistent distance from the actual recording 
microphone, whether it is in the head portion of the microphone structure 902 or is under the 
opening 904 in the platform 900, thereby providing higher quality recordings. Any of the 
above-described features for the data cartridges and/or the above-described electrographic 
position location apparatuses can be combined any suitable manner with the features shown 
in FIG. 10. For example, although the recording electronics that are shown in FIGS. 4-5 are 
described with reference to a data cartridge, they can be used with in an electrographic 
position location apparatus that does not need to use a data cartridge. 
[0105] The terms and expressions which have been employed herein are used as 

terms of description and not of limitation, and there is no intention in the use of such terms 
and expressions of excluding equivalents of the features shown and described, or portions 
thereof, it being recognized that various modifications are possible within the scope of the 
invention claimed. Moreover, any one or more features of any embodiment of the invention 
may be combined with any one or more other features of any other embodiment of the 
invention, without departing from the scope of the invention. For example, the data cartridge 
shown in FIG. 3 can be used in any of the electrographic position location apparatuses 
described in the application without departing from the spirit and the scope of the invention. 
[0106] All references, patent applications, and patents mentioned above are herein 

incorporated by reference in their entirety for all purposes. None of them are admitted to be 
prior art to the presently claimed inventions. 
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